Matryoshka Sentence Embedding
Embedding model
Large Language Model
AIの圧縮・高速化
LLMの圧縮・高速化
表現学習
蒸留
Transformer
Matryoshka Sentence Embeddings
https://arxiv.org/abs/2402.14776
MatFormer: Nested Transformer for Elastic Inference
https://arxiv.org/pdf/2310.07707